Supersymmetric Higgs mediated lepton flavor violation at a Photon Collider 
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We study a new signature of lepton flavor violation (LFV) at the Photon Collider (PC) within 
Supersymmetric (SUSY) theories. We consider the minimal supersymmetric standard model within 
a large tan/3 scenario with all superpartner masses in the ©(TeV) while the heavy Higgs bosons 
masses lie below the TeV and develop sizable loop induced LFV couplings to the leptons. We consider 
a photon collider based on an e^e~ linear collider with = 800 GeV with the parameters of the 
TESLA proposal and show that, with the expected integrated 77-luminosity L^^ — 200 500 fb~^, 
the "/^r fusion" mechanism is the dominant channel for the process 77 — > /ir66 providing detailed 
analytical and numerical studies of the signal and backgrounds. We impose on the parameter space 
present direct and indirect constraints from B physics and rare LFV r-decays and find that the 
LFV signal can be probed for masses of the heavy neutral Higgs bosons A, H from 300 GeV up to 
the kinematical limit ~ 600 GeV for 30< tan (3 <60. 

PACS numbers: 11.30.Fs, 11.30.Pb, 12.60.Jv, 14.80.Ly, 14.80.Cp 
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I. INTRODUCTION 

There is an emergent consensus in the physics com- 
munity that the next complementary step to the Cern 
large hadron collider (LHC) will be the International Lin- 
ear Collider (ILC) which will collide e+e" beams with a 
center of mass energy in the range 2£'e — 500 — 1000 
GeV fl!, 2']. It is also well known, since the pioneering 
work of the Novosibirsk school, that such a linear collider 
could offer the possibility of working in the so called 67 
or 77 modes thus realizing a very high energy photon 
collider (PC) with polarized photon beams 

A vast literature is already available on the ILC and 
the PC potentialities for the discovery and precision mea- 
surement of the properties of the Higgs boson, the miss- 
ing piece of the Standard Model (SM) of electro-weak 
interactions. Moreover, the properties of extended Higgs 
sectors of many well motivated theories beyond the SM 
have been widely considered as well. Among these, the 
Minimal Supersymmetric Standard Model (MSSM) has 
received particular attention, for reviews see 0, [1]. 

However, the MSSM (like the SM) does not provide 
any explanation for the neutrino masses and mixing. In 
order to accomplish this task, the seesaw mechanism is 
usually implemented in the MSSM. Hence we are led to 
study a MSSM with right handed neutrinos (i^-MSSM). 
Compared to the MSSM, the main novelty in the v- 
MSSM is the presence of lepton flavor violation (LFV). 
LFV effects arise both in the gauge interactions [Q| 
(through lepton-slepton-gaugino couplings) and in the 
Yukawa interactions (3]. In particular, LFV Yukawa in- 
teractions are greatly enhanced at large tan (3, and give 
the possibility of detecting LFV decays of the Higgs 
bosons at LHC [1, 0] and ILC in the e^e~ mode [lo| . 
In Refs.[lll[T^.[l^ loop level lepton flavor violating pro- 



e+^^ {i = fir), and 77 iiij 
{£i 7^ ij), which are potentially striking signatures of 
LFV, were studied in detail. 

In this work we extend these previous studies and 
discuss a new mechanism of lepton flavor violation at the 
photon collider via the Higgs mediated {H, A) process: 

77 — > iirbb (1) 

in a scenario of large tan/3 where all the super-partner 
masses are C'(TeV) and the heavy Higgs bosons {A, H) 
have instead masses below the TeV and develop sizable 
loop induced LFV couplings to the SM leptons. 

In photon-photon collisions the main production 
mechanisms for the Higgs bosons are 77 fusion 4] (and 
references therein) and rr fusion [Ij]. In the first case, 
the Higgs is produced as an s-channel resonance through 
a loop involving the exchange of massive charged parti- 
cles. In the rr fusion process 77 rrbb, the Higgs is 
produced in the s-channel with a rr pair and can be de- 
tected with its decay mode bb. We show that the main 
LFV process is the //r fusion to the Higgs, see Fig. H^), 
which dominate the 77 fusion, with large cross section 
over large portion of the parameter space. The signal 
from the fir fusion 77 — > ^rbb consists of a /ir pair plus 
bb jets from the Higgs decay, allowing the possibility to 
detect and reconstruct the Higgs through its main decay 
channel and to measure , at the same time, the size of 
LFV couplings. In Rcf. [lj| it is shown that the lepton 
flavor conserving (LFC) channel 77 rrbb ( "rr fusion" ) 
allows to measure tan (3 with a precision which is better 
than 10% at large tan/3. 

The plan of the paper is the following. In Section HIl 
we review the theory of lepton flavor violation related 
to the MSSM Higgs bosons and discuss their properties 
within our scenario. Section UTTl is devoted to the analyt- 
ical evaluation of the signal cross sections at the photon 
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FIG. 1: Diagrams for the process 77 — * firbb: the topology 
(a) is the one we call nr fusion. The black blob represents 
the loop induced LFV coupling treated as an effective vertex. 



collider; in Section IIVI we present numerical simulations 
of both the signal and the background. The correlations 
among the signal at the PC and the constraints imposed 
by B physics and the non observation of SUSY particles 
and lepton flavor violating rare r-decays is discussed in 
Section |Vl Finally, we give a summary and the conclu- 
sions in Section 



leptonic flavor changing neutral current effects will re- 
main undetermined even in the very optimistic situation 
where all the relevant New Physics masses were measured 
at the LHC. More stable predictions can be obtained em- 
bedding the SUSY model within a Grand Unifled Theory 
(GUT) where the see-saw mechanism can naturally arise 
(such as SO{10)) In this case the GUT symme- 

try allows us to obtain some hints about the unknown 
neutrino Yukawa matrix Y^,. 

There exist two different classes of LFV contribu- 
tions to rare decays: gauge-mediated LFV effects through 
the exchange of gauginos and sleptons [1, [H, 
and Higgs-mediated LFV effects through effective non- 
holomorphic Yukawa interactions for quarks and leptons 
0, : once a source of LFV is given in the slepton mass 
matrix, for example Eq. ([2]) in MSSM with the see saw 
mechanism, LFV Yukawa coupling of the type L]^L-'j^H* 
are induced at loop level and become particularly sizable 
at large tan /?. 

In the mass-eigenstate basis for both leptons and 
Higgs bosons, the effective flavor-violating Yukawa inter- 
actions are described by the lagrangian: 

X [cp-ah — Sp-aH — iA) + h.c. 

(3) 



II. HIGGS LFV IN SUSY 

Within a SUSY framework, LFV effects originate 
from any misalignment between fermion and sfermion 
mass eigenstates. In particular, if the light neutrino 
masses are obtained via a see-saw mechanism, the radia- 
tively induced off-diagonal (LFV) entries in the slepton 
mass matrix {m'^j )ij are given by [gI [isl. [T6|: 



(MA 



(2) 



where Mx denotes the scale of SUSY-breaking medi- 
ation, Mr the scale of the heavy right-handed neu- 
trinos masses, mo the universal supersymmetry break- 
ing scalar mass and the Yukawa couplings between 
left- and right-handed neutrinos (the potentially large 
sources of LFV). Since the see-saw equation — 
—Y^M^^YJ {Hy}^ , with (Hu) is the vacuum expectation 
value of the up- type Higgs, allows large {Y„Yj}) entries, 
sizable effects can stem from this running. The determi- 
nation of {rrv~^)i^j would imply a complete knowledge of 
the neutrino Yukawa matrix {Y^)ij, which is not possible 
even if all the low-energy observables from the neutrino 
sector were known [l^l. As a result, the predictions of 



where a is the mixing angle between the CP-even Higgs 
bosons h and H , A is the physical CP-odd boson, 
are the physical charged Higgs-bosons and we adopt the 
notation {cg,sg,tg) — (cos 0, sin 0, tan 0). We note that 
in Eq. ^ i,j are flavor indices that in the following are 
understood to be different (i ^ j). 

In supersymmetry, the couplings A*-' in Eq. ([3]) are 
induced at one loop level by the exchange of gauginos and 
sleptons, provided a source of slepton mixing is present. 
In this work the analysis at Higgs LFV effects will be 
model independent and we use the expressions of 
obtained in the mass insertion (MI) approximation [21i |: 



A^ = - ^f^AhSt 



Aw 



LL"'-L 



I'{Mlm%ml) + -I'iMlf,',ml) 



(4) 



A% = ^^,M,ml6%,, [I'{Ml^i\ml)-{^,^m^)\ (5) 



where /i is the the Higgs mixing parameter, Mi^2 are 

^L{R) 



the gaugino masses and mfir,-. stands for the left-left 



3 




FIG. 2: (Top-left panel) Total width of the A Higgs boson for large values of tan/3 explained in the legend. (Top-right panel) 
Branching ratios for the main decay channel bb and t^t~. (Bottom- left panel) Branching ratio for 77 decay. (Bottom-right 
panel) Branching ratio for the LFV decay A —> fir. The results are obtained by means of the code FeynHiggs [20| ] and Eq. 
(HU with SUSY parameters Msusy = Mi,2,3 = 1 TeV, m = 2 TeV, = |Af p |Af p = IQ-^. 



(right-right) slepton mass matrix entry. The LFV mass 



insertions and 5]^^ are defined as: 



(6) 



where (rrij^y^ are the off-diagonal flavor changing entries 
of the slepton mass matrix. Let us emphasize that the 
parameters S^^j^ and (5]^^ will be treated in the following 
study as free parameters in order of provide a model in- 
dependent study of LFV signals. The loop function /' is 
defined by I'[x,y,z) — dl(x,y,z)/dz, where I{x,y,z) is 
the three point one-loop integral 



I{x,y,z) 



xy log{x/y) + yz log(y/ z) + zx log{z/x) 
{x - y){z - y){z - x) 



(7) 



While gaugino mediated lepton flavor violation de- 
couples with the heaviest mass in the slepton/gaugino 
loops msuSY , Higgs mediated effects of LFV do not de- 
couple increasing the sparticles masses because A/,, A^, 
which appear in the couplings of the dimension-four la- 
grangian (Eq. [3]) , are dimensionless coefficients given by 



ratios of SUSY masses. Higgs mediated effects in rare 
decays start being competitive with the gaugino medi- 
ated ones when msuSY is roughly one order of magni- 
tude heavier then ruH and for large tan f3. Phenomeno- 
logical analysis of rare LFV t decays and B meson de- 
cays have been wideljy discussed in the recent litera- 
ture 0, M M M MMMMMMMMM- 

The Higgs boson decay widths and branching ratios 
relevant for the following analysis at a photon collider 
are obtained by means of the lagrangian of Eq. ([3]) us- 
ing the approximation l/c| ~ tan^ /3 (only valid in the 
large tan (3 regime) and in the limit of massless fermions. 
Introducing A^ = lAf]"^ + jAfj^p we find: 



1 mj 



Ma4 



(8) 



where v = {v'^ + ^d)^^^ ~ ^46 GeV, Vu and Vd being the 
expectation values of the Higgs fields and H^- The 
width for the lepton flavor conserving decay to t~^t~ pair 
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is, with the same approximations: 

8n ' 

and therefore: 



(9) 



(10) 



Finally since r(yl ^ T+/i ) = V{A^ t /i+) we find 
also: 

r(A -> r+/x-) + r(A ^ r-/x+) = t?,A2r(A r+T-), 



B(^ A^^^") + S(A ^ /^-r+) = A26(A ^ r+T-). 

(11) 

For the heavy higgs boson iJ, the right hand sides 
of Eq. pTjl . should be multiplied by a factor (s^-q/cq.)^. 
Let us remark that the light Higgs field h has negli- 
gible lepton flavor violating decays since its coupling 
cos(/3 — a) ^ in the decoupling regime. In Fig. [2] 
we show B[^A — > 66) and B(^A — + 77) for different val- 
ues of tan and for the reference point of the parameter 
space MsusY = -^1,2, 3 = 1 TcV, /i = 2 TeV. For com- 
pleteness, in Fig. [2] we also report the absolute value of 
the total width and the branching ratio for the LFV 
decay A ^ fir given by Eq. ((TTl) with = 10"'^.^ We 
note the following features: i) the total width is of the or- 
der of a few GeV, comparable, but always smaller, than 
the expected resolution of the invariant mass of the bb 
system (see Section ITV)) : ii) the total decay with is sat- 
urated almost exactly by the two decays A ^ bb and 
A TT while ^ — > 77 is strongly suppressed; ii) fi- 
nally the branching ratio B{A — s- fir) is in the interesting 
region of 10^'' ~ 10^^. 



III. HIGGS LFV AT A PHOTON COLLIDER 

High-energy photons beams 0, ^ will be obtained 
from Compton back-scattered (CB) low-energy laser pho- 
tons with energy loq off high-energy electron beams with 
energy Ef,. These high-energy photon beams will not 
be monochromatic but will present instead an energy 
spectrum, mainly determined by the Compton cross sec- 
tion. The spectrum of the fraction of the electron's en- 
ergy retained by the photon have a maximum at E^^^ — 

VmaxEe, whcrC Umax = X / {x + 1) with X = AEeLOo/ml. 

As a consequence, if yi and j/2 sue the fractions of ener- 
gies of the colliding photons, the number of photon colli- 
sions as a function of the invariant mass W^-y — ?/i?/22i?e 



^ We note that our formula in Eq. ^ agrees with the correspond- 
ing formulas in Ref. |2m. l3j| |. but we find a disagreement by a 
factor 1/2 with that in 



will present a spectrum too. In first approximation, the 
luminosity spectrum is given by the convolution of two 
Compton cross-sections, that is 



dz 



2z 



\TXymlz 



In Km/z 



F,ix,ze+'^)F,{x,ze-'^)dr,, (12) 



where we introduce the variables 



Wj^/2Ee = ^/syj/See, V = In y/yi/y2 and Fc is the 
Compton cross section; thus s^^ 



2 



with Se 



(2i?e)2. Even if the simulated realistic differential spec- 
trum as a function of z cannot be described analytically, 
the luminosity peak near Zmax is almost independent 
from the details of the machine, and is well described 
by Eq. p^ . We consider a PC taking the parameters of 
TESLA(800): 2Ee = 800 GeV, x = 5.2. 2Ej in the re- 
gion of the peak covers the range 535 — 670 GeV, and the 
corresponding photon-photon luminosity at the peak is 



L^-y{z > O.Szm) = 1.7 X lO^"* cm 



-2 s-i 



500 fb"^ yr" 



To use these numbers as representative of the PC lumi- 
nosity, we follow the approach of Ref. [l^] , in which the 
ideal spectrum, Eq. p2)) . is normalized in the following 
way: 



dL^^ 
dz 



1 



dLOB 



Jo. 



8z„ 



dz 



dLCB 
dz 



dz 



(13) 



Defining the effective cross section as: 



lax J T norm 

dz 



(14) 



the total number of events can be evaluated to be 



N, 



X a''-^^ , where L^^ is the simulated TESLA 



events ^'y^ 

luminosity at the peak. 

In photon-photon collisions the main production 
mechanisms for the Higgs bosons are 77 fusion 'J] and 
rr fusion In the first the Higgs is produced as an s- 
channel resonance through a loop involving the exchange 
of all charged massive particles. This process is particu- 
larly well suited for precision studies of the Higgs sector 
when the mass(es) of the Higgs boson(s) is (are) known, 
given that the width of the decay into two photons (which 
controls the production cross section) is not too small. 
Assuming that the machine energy could be tuned to the 
Higgs mass then one could take advantage of the resonant 
production in order to probe the details of the Higgs sec- 
tor. However in the case of tan/3 enhanced Higgs-lepton 
coupling the tt fusion becomes competitive or even dom- 
inant over a wider range of masses. In order to appreci- 
ate the differences between the two mechanisms, we first 
give analytical expressions of the cross sections for the 
LFV Higgs mediated signals and then make numerical 
estimates. For clarity, we fix the following SUSY pa- 
rameters to: MsuSY = Mi,2.3 1 TeV, /i 2 TeV, 
tan/3 = 50, A^ = \ Af\^ + \Af\^ = 10"^, as for the cal- 
culation reported in Figure the widths and branching 
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FIG. 3: (Left panel) Cross section for 77 ^ A ^ /ir as a function of Ma'- dashed line monochromatic photons, in full line 
the effective cross section with photons luminosity. (Right panel) Cross section for 77 — > ^irbb . Full line: monochromatic 
photons and equivalent particle approximation plus small width approximation, Eq. psp . Dashed line: effective cross section, 
Eq. ITg]). Dot-dashed line: exact result by CompHeP. The relevant parameters are tan/3 = 50, |Ai^|^ + |A|^p = 10"*^, 
MsusY = Mi,2,3 = 1 TeV, m = 2 TeV. 



ratios which appear in the following formulas are com- 
puted with the software FeynHiggs ^] linked to our 
own code. 

The cross section for the resonant process 77 A ^ 
/ir in the monochromatic case is provided by a Breit- 
Wigner formula 



cr(s^ 



Stt 



r(yl -> 77)r(A Ty) 



(I + A1A2) (15) 



where Ai,2 are the photons helicities and we take A1A2 = 
1. The effective cross section is obtained by folding 
Eq.( [H]) in Eq. ([H]). In Fig. [3] we plot with a dashed 



line the monochromatic cross section with 2E~t 



600 



GeV and with a full line the effective cross section with 
2Ee = 800 GeV: the resonance peak at Ma = 600 GeV is 
only smoothed by the effect of the photon spectra, while 
it is clear that in mass regions away from the resonance 
the effect of the photon spectra is totally negligible. Even 
if the resonant effect is evident around Ma = 600 GeV, 
the cross section is rather small, at the level 10~^ 10~^ 
fb, being suppressed by T{A — s- 77) which in our scenario 
is 0(10"*^) GeV, as can be seen in Fig. [2] 

The /iT fusion process 77 — > ^rbb corresponds to 
the diagram (a) in Fig. [TJ Here the Higgs boson is pro- 
duced in the s-channel via a virtual /^r pair and can be 
detected from its decay mode A — > hb. The black blob 
in the vertex of the diagram represents the loop induced 
LFV coupling. A first estimate of the production cross 
section can be obtained using the equivalent particle ap- 
proximation (EPA) wherein the colliding real photons 
split into r and /i pairs with the subsequent fiT fusion 
into the Higgs boson. Following Ref. [lj|, we introduce 



the photon splitting function into a pair of leptons 

P^,,{x) = ^[x^ + {l-xY]\n{^^^ (16) 

where x is the fraction of the energy of the photon car- 
ried by the virtual lepton and /i_F is the factorization 
scale that we set to = Ma- The on shell /it bb 
fusion cross section in the center of mass frame is easily 
calculated from the lagrangian of Eq. ([3]) and expressed 
in terms of the partial widths given in Section [m 



47rr(A T^i)T{A hh)s 
[TaMaY 



Ml{s- 



MlY- 



(17) 



where s is /ir center of mass energy squared. The cross 
section for monochromatic photons is given by the con- 
volution of Eq. ()17p with the splitting functions, 

ct(77 fJ,Tbb;Sy^) = 2 J dXi_,dXrPy/^,{Xfj,)P^/r{Xr)cr{s), 

where s^^ is the center of mass energy squared of the 



s-yj and the 



photons which is related to s by s 
factor two is the multiplicity factor which accounts for 
the exchange of the initial photons. The formula is sim- 
plified by changing the integration variables {x^,Xr) to 
(77, s) with 77 = In y^Xfi/xr and using the small width 
approximation (SWA) when performing the integration 
over s- The result is: 



47r2 T{A Tn)B{A bb) 



x2 r'"'^*d77P^/^(ie'')P^/,(ie-'') 

In l/t 



(18) 



6 




(GeV) (GeV) 

FIG. 4: (Left-panel) Total cross for 77 — > /ir6& with monochromatic photons at 2E^ = 600 GeV as a function of Ma and 
tan/3 = 50. Full line: all contributing diagrams with A and H. Dashed line: only diagrams with A. Dot-dashed line: bb fusion 
cross section. Dotted line: contribution of the peripheral diagrams. (Right panel) Exact cross section with A and H diagrams 
for different values of the tan/3. The other parameters are the same as in Fig. Q. 



with t = Ma/2E^. Finally, the effective cross section is 
obtained by the convolution of Eq. with the photon 
spectra; defining t = Ma/2E^ we have 



47r2 T{A ^ Tfi)B(A bb) 



dz 



Ma 
dz 



f+lnl/zt' /,/ \ /,/ 

X 2 / d77 P^/^ -e" P^/r -e-" 

-Inl/zt' / 



(19) 



In Fig. [3] we plot the Eq. dH]) and Eq. ^ as func- 
tions of Ma- The cross section is in the range 10^'^ — 1 
fb in the range of Higgs masses 100 — 550 GeV, thus 
dominant respect to the 77 fusion one. Moreover, the 
use of the photon luminosity spectrum with 2Ee — 800 
GeV and x = 5.2 gives the same numerical results for 
the cross section calculated with monochromatic pho- 
tons with 2E^ — 600 GeV which represents the value 
of the mean energy at the luminosity peak, 535 GeV 
< 2E^ < 670 GeV, so that from now on we consider 
this situation of monochromatic photon beams to sim- 
plify the calculations. 

To estimate the accuracy of the analytical formulas 
we also show in Figure [3] (right plot) the cross section 
calculated with Eq. (fTSll and the one calculated with the 
program Comphep [33] in which we have implemented 
the MSSM with LEV as described by the lagrangian in 
Eq. ([3]). The dotted dashed curve is obtained consider- 
ing the /ir fusion diagrams and bremsstrahlung diagrams 
with the A boson contribution. Figure [IJa-b) , which, as 
we show explicitly in Section IIVI are the dominant dia- 



grams. The analytical result gives the correct order of 
magnitude of the cross section, but for low Higgs masses 
it underestimates the exact result by a a factor 3~5, 
and only for masses approaching to 2E-y, the kinemat- 
ical limit, the approximation is better. This analytical 
study served us to provide a preliminary evaluation of 
the orders of magnitude of the signal and to understand 
the dominant mechanisms involved. In the following Sec- 
tion [IV] we present the results of full numerical tree- level 
simulations obtained by means of Comphep. 



IV. SIGNAL AND BACKGROUND 



The process 77 — > firbb mediated by the heavy Higgs 
bosons A and H is described by a set of 40 diagrams 
which can be classified by the three topologies depicted 
in Figure[TJ (a) the /ir fusion diagrams where the Higgs is 
in the s channel; (b) bremsstrahlung diagrams, where the 
Higgs is radiated by a lepton of an external leg; (c) pe- 
ripheral diagrams, where the Higgs bosons are exchanged 
in the t — (u) channel. In our numerical calculations we 
have divided them into three groups: (group-1) 12 dia- 
grams (topology (a) and (b)) describe what we call "^r 
fusion" to A, H; (group-2) 12 diagrams which describe 
"66 fusion" to A, H (the are given by the topologies (a) 
and (b) of Fig. [T] with the role of ^jlt and bb excahnged) ; 
(group-3) 26 diagrams of topology (c) that we call "6/ 
fusion" . 

In Figure [H left panel, we plot the contribution to 
the total cross section of these groups, a^r, and au, 
respectively. We observe the following features: abb: even 
if it is described by diagrams with the same phase-space 




FIG. 5: (Left column) Distributions for scattering angle respect the collision axis for leptons and jets. (Central column) 
Distributions for the energy of leptons and jets. (Right column) Distributions for the transverse momentum of leptons and 
jets. Black line: Ma,h = 150 GeV, Magenta: Ma,h = 300 GeV, Cyan: Ma,h = 500 GeV. The other parameters are the same 
of Figs. @. 



structure of cr^r , is two orders of magnitude smaller be- 
cause those diagrams with two 6-quark attached to pho- 
ton Hues bring in a charge factor of (1/3)^ in the ampli- 
tude; ati is three orders of magnitude smaller of ct^t-, both 
for the presence in the diagrams of at least one 667 cou- 
pling and the absence of s-channel resonant propagators; 
finally we note that in (7^.^ the contributions of diagrams 
with A and H sum up incoherently, i.e. their interference 
vanishes. Since in the limit of large tan/3, Ma ~ Mh 
and also the couplings of the higgs bosons A and H be- 
come approximatively equal we have aA+H ~ '^<^A- We 
conclude that the signal cross section is completely de- 
termined by afj_r, while atb and au, which are irreducible 
backgrounds are negligible. (We also checked that the 
interference of these subleading contributions with the 
dominant one is negligible.) 

The right panel of Figured] shows the total cross sec- 
tion fff^T for tan /3 in the range 30 < tan /3 < 50 as a func- 
tion of Ma; a factor of two as been included to account 
for the charged conjugated process which has the same 
total cross section. With = |Al|2 jA^p = iQ-e 



the cross sections range from 10^^ fb to 2 fb with Ma 
ranging from 150 GeV to w 550 GeV. Assuming an in- 
tegrated luminosity for the photon collider in the range 
200 — 500 fb^^/yr, a relatively large number of events are 
thus predicted, from Mevents ~ 200 - 500 for Ma = 100 
GeV down to Mevents - 20 - 50 when Ma « 550 GeV. 
However, we show in the next section, that these num- 
bers are rather optimistic. The results on the collider 
cross sections must be correlated with the constraints on 
the Susy spectrum, i3-physics and LFV t decays are con- 
sidered. Once this is done the allowed parameter space 
is reduced and more realistic predictions emerge. 

In Fig. m left column, are shown the angular distri- 
butions as function of the cosine of the angle between one 
particle (/k,t, jet) with the positive direction of the colli- 
sion axis for three values of Ma,h — (150, 300, 500) GeV. 
The distribution is peaked along the collision axis for the 
leptons and the effect is more pronounced at low Higgs 
masses, while for jets the cross cross section is less con- 
centrated in the forward-backward directions and is prac- 
tically flat for Ma,h above 300 GeV. The distributions in 




FIG. 6: (Left column) Distributions for opening angle between the two leptons and the jets. (Right column) Distributions for 
the invariant mass of leptons pair and bb. Black line: Ma,h = 150 GeV, Magenta: Ma,h ~ 300 GeV, Cyan: Ma,h = 500 GeV. 
The other parameters are the same of Fig. (|3]). 



the transverse momentum (right column) are consistent 
with the angular distributions, leptons have low pT, the 
quarks have high transverse momentum with distribution 
peaked around Ma,h/'^- For the b-jets also the energy 
distribution (central column) is peaked at Ma,h/'2^ while 
leptons are more energetic for low Higgs masses. Other 
interesting features of the signal are given by the distri- 
bution for the cosine of the angle between the leptons 
and jets shown in Fig. [SI left column. Both are peaked 
towards cos dij —1, thus both the lepton pair and 
the jet pair will be well separated being almost back-to- 
back, the effect being stronger for the b-tagged jets at 
high Ma,h- On the right column, we plot the invariant 
mass distribution for /ir pair and the bb pair: while the 
former extends up to y^s^— Ma,Hi the latter has a peak 
at the Higgs mass, as expected, because of the s-channel 
propagator in the amplitude. Thus the signal has the 
following characteristics: the Higgs decay to a pair of 
back to back &-jets with energy and transverse momen- 
tum around MaI^ and invariant mass peaked at Ma- 
The /i and the r are also back to back and in forward- 
backward directions with low Pt- 

The background processes from the SM are the ones 
with the final state /irM-t- neutrinos. The main processes 



are: 

(a) 77 ^ Z*Z* {bb){T+T*-) bbr+fi-i/^iyr 

{b)^-f W*+W*-Z*{^*) ^ {T+l^r)it^-l7^)ibb) . 

The cross sections for double and triple gauge boson pro- 
duction are known to be large in photon-photon colli- 
sions [2]. At = 600 GeV they are: (7(77 ^ ZZ) = 
0.2 pb and (7(77 WWZ) = 0.7 pb. We estimate 
the cross section for the complete processes by multi- 
plying the above numbers by the appropriate branching 
ratios for the decay chains and find: aa — 1.77 x 10"^ 
fb and (Jh ~ 1.26 fb. The jets coming from Z decay have 
very different distributions and energies from those of the 
jets from Higgs decay. Moreover, while the signal has no 
missing energy or missing transverse momentum, the two 
neutrinos in the final state of the SM backgrounds carry 
away a large fraction of the energy/momentum, thus pro- 
viding large missing energy and momentum. 

As the bulk of the cross section is determined by 
those regions of phase space where the leptons are emit- 
ted with small angle and low transverse momenta and 
therefore might escape detection, it is essential to evalu- 
ate the expected number of events including angular cuts. 
We apply a cut of 6* > 130 mrad on the scattering angles 
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TABLE I: Effect of cuts on tlie cross section for 77 ^ urbb: ct'^"* is obtained imposing for all particles in the final state: 
scattering angle 6 > 130 mrad, E > 5 GeV, bb invariant mass AIa — 5%Ma < Mj,5 < AIa + 5%Ma- In a'ji!^^ a cut on transverse 
momentum of leptons pr > 5 GeV is added. 



Ma (GeV) 


cr™* (fb) 


^pI' (fb) 


(J™* (fb) 


crp^' (fb) 




tan P = 40 


tan/3 = 40 


tan (3 = 50 


tan 13 = 50 


150 

200 
300 
400 
500 


0.240 
0.186 
0.122 
0.070 
0.052 


0.124 
0.096 
0.074 
0.042 
0.024 


0.660 
0.520 
0.340 
0.240 
0.148 


0.340 
0.280 
0.172 
0.160 
0.076 



of leptons and jets for detector acceptance and further a 
cut on the energy of both leptons and jets: E > 5 GeV; 
the invariant mass of the bb system is required to be in 
the range Ma ± 0.05Ma, which is the expected experi- 
mental resolution [ij]- We find that after the cuts the 
background processes have cross sections at the level of 
10"'^ — 10""* fb, while the effect on the signal cross sec- 
tion can be read off from Table I. In particular we observe 
that the cut on the invariant mass Mbt suffices to sup- 
press background processes. Comparing the numerical 
results shown in Table I (ct^"*) with Fig. |3]wc note that 
the signal cross section is reduced by a factor of three; 
moreover we show also the effect of a supplementary cut 
on transverse momentum of leptons pr > 5 GeV which 
reduces the cross section (cTp"*) by another factor of two 
as one might expect given the transverse momentum dis- 
tributions. On the contrary, we find that the cut on the 
energy can be raised up to 50 GeV lowering the cross 
section only of « 20%. 

Another source of background are fake events where 
the muon comes from the decay of a r in the lepton flavor 
conserving process 77 —^ T^T~bb: this process has the 
same characteristic of the signal, and will pass the above 
cuts. The used version of Comphep allows the study of 
six particle final states, and works properly if we restrict 
the numbers of contributing diagram: thus we considered 
the dominant diagrams in tt fusion with one r decay- 
ing r — > vvfj,. We find, without any cut, cross sections 
4 X 10-2, 2.4 X 10-2, 6.2 x IQ-^, 7.2 x 10-'', 2.1 x IQ-^ fb 
for masses Ma,h = 150, 200, 300, 400, 500 GeV respec- 
tively. The suppression and the rapid fall with increasing 
Ma can be understood kinematically: the tree-body de- 
cay of the very energetic r is disfavored for phase space 
reasons, especially at large Ma where the b are more en- 
ergetic, as discussed above, and less energy is sheared by 
the leptons. 

We finally remark that the LFV channel we are con- 
sidering would naturally be a second stage study after 
a thorough investigation of the LFC rr channel is per- 
formed, which should allow precision studies of the Higgs 
sector {Mh,a, tan f3 etc.). Thus, once the mass and other 
properties are known, the search for the LFV channel 
would be facilitated: for example, the fact that the in- 



variant mass of the leptons is peaked at 2E^ — Ma may 
be useful in selecting the signal (though the center of 
mass energy of the PC is not exactly fixed, as discussed 
above, at the luminosity peak the photons are almost 
monochromatic) . 



V. CORRELATIONS WITH LOW ENERGY 
CONSTRAINTS 

The Higgs bosons LFV vertices and the branch- 
ing ratios depend on the parameters of the theory 
(MSSM+LFV) that are subject to non-trivial constraints 
by experiments. In order to provide a detailed study of 
the possibilities of a photon collider with respect to the 
LFV violating signal 77 firbb we scan over the follow- 
ing parameter space: 

ITeV < {^i,mg,Au,Ad,mL,mR)<5TeV, 

500 GeV < (Ml , M2 , M3) < 5 TeV, 

150 GeV < Ma < ITeV, 

30 < tan/3 < 60, 

10-' < (<5ii,4fl)<0.5. (20) 

The parameters ((^ii, (^fj^^), defined in Eq. [SI measure, 
in a model independent way, the amount of lepton flavor 
violation. We verifled that (5£^, which give the most im- 
portant contribution, should be greater than ~ 5 x IQ-^ 
to have substantial cross section. 

We impose the SUSY parameter space to respect 
the following constraints: lower bound on the light Higgs 
mass rrih > 114.4 GeV; upper bound on the anomaly 
of the muon magnetic moment {g — 2)^ < 5 x 10-^ ; 
bounds on electro-weak precision observables such as 
Ap < 1.5 x 10^"^; direct search constraints on the lightest 
chargino and sfermion masses and constrains on squarks 
and gluino masses from LEP and Tevatron are automati- 
cally satisfied as they lie in the TeV range in our scenario. 

Some i3-physics processes, namely Bg /^^M i 
B — > Xgj and i?„ — *■ tv, are particularly sensitive to 
tan (3 enhanced Higgs contributions which have been sub- 
ject of extensive recent studies [13, IH, IH, |3l|. In par- 
ticular: using the formulas for the branching ratio given 



10 



^ 10" 

i: 

I 10-' 

10 



10 i 



■II 



10" 

7 



10 
10 

^ 10-' 

i: 

10 



10 ^ 



= III 

— 
- 


1 1 1 II 


1 1 1 1 1 1 1^ 

— 
- 

































1 1 1 


1 






-s 



10 



I 10-^ 



10 



10"^ 

<j(yy-*lizhh) (fb) 



10^ 



10 



10 



11 




I 



10 



■11 



= ' 1 


' 1 ' 1 ' 1 ' 1 ' 1 
















1^500 fb"' I 




1^200 fb"' I 


" 1 1 


" 



10 
60 



I I 

■4 , „-3 . .-2 



10 



50 - 



CO, 



40 - 



50 100 150 200 250 300 



30 




events 



200 300 400 500 600 



FIG. 7: (Top left panel) Correlation between B{t — > jirj) and (7(77 /irbb). (Top right panel) Correlation between B{t — > ^7;) 
and A — > fir. (Bottom left panel) Correlation between B{t — ^ firj) and the number of expected events for two values of the 
integrated luminosity. (Bottom right panel) Distribution of the signal cross section in the (Ma, tan /3) plane. The parameter 
space and the imposed constraints are discussed in the text. 



in Ref. [29| we require that the parameter space satisfies 
B{Bs M+M") < 6.5 X 10-8 [H; Rr^, the ratio be- 
tween the SUSY and SM branching ratios for Bu tz/, 
is required in the bracket 0.70 < Rru < 1-44 using the 
formula in Ref. [3l| and the numerical bounds from [s^] ; 
Rxsjj the ratio between the SUSY and SM branching 
ratios for B Xsj, is required to lie in the bracket 
1.01 < Rx,-y < 1.25 through the formulas of Ref. 
and the numerical bounds are taken from ^o| . 

At last, we impose the current upper bounds on LFV 
T decays to be respected: 13{t~ y^'v) < 6.8 x 10"® and 
B{t~ tJ'~l) < 5.6x10-8 [33|. In the case where Higgs- 
mediated LFV effects are important, t ^ ^r] is generally 
the dominant process [2^. [23l[25j. 

We employ the analytical formulas of Section II for 
the cross section which gives a reasonable estimate when 
cuts are taken into account. 

In Fig. [71 top-left panel, we show the correlation 
between B{t nrf) and (7(77 — s- firbb), while in the 
bottom- left panel, the correlation between B{t ^ /i?/) 
and the numbers of iirbb events given by the previous 



cross section available at a photon collider for two values 
of the integrated luminosity, C = 200 — 500 fb^^/yr. It 
can be seen that for the high luminosity option we can 
expect up to 250 events per year, and up to 100/yr for the 
low luminosity option. The above conclusions are valid 
for the present upper limits on the branching ratios: if in 
the near future the experimental upper bound will be im- 
proved (i.e. lowered), say by an order of magnitude, only 
few tens of events can be expected unless higher values 
of luminosity should become in the meantime available. 

In the bottom-right panel we show the region of the 
parameter space in the (M^,tan/3) plane which is char- 
acterized by a signal cross-section a > 10~^ fb. Let us re- 
mark that the signal cross-sections becomes larger at low 
Ma masses, see Fig. 0] and Eq. ([T5|. However in the con- 
sidered region of large tan /? values such low masses are 
excluded by the imposed constraints. In particular, the 
LFV signal for AIa masses below 300 GeV are excluded 
for all values of tan/3 in the interval, 30 < tan/3 < 60. 
We have checked that requiring a signal cross section 
10-^fb < a < 10"^ fb the same region in the {Ma, tan /3) 
plane is covered. 
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Finally, in the top-right panel we show the correla- 
tion between B{t firj) and B{A fir). The latter 
gets values in the interval (5 x lO^"') < B{A jir) < 
(8 X 10~^). Even if the upper limit on B{t — > //ry) is 
lowered by an order of magnitude form its actual value 
10^^) we see that B{A ^it) can still reach values 
up to 0(10"'^) which are particularly interesting for the 
LHC, where the cross section for heavy neutral gauge 
bosons production in bb fusion is sizable 



VI. SUMMARY AND CONCLUSIONS 

In this work we present a detailed study of LFV sig- 
nals at a photon collider, namely 77 — s- firbb, mediated 
by the MSSM heavy Higgs bosons {A, H). Our approach 
is model-independent with respect to the source of lepton 
flavour violation. Effective couplings of the MSSM higgs 
bosons which violate lepton flavor conservation arise at 
loop level once in the model (MSSM) it is introduced 
a source of LFV in the slepton mass matrix. This hap- 
pens for example in the so called J/-MSSM (SUSY see-saw 
mechanism) where off-diagonal elements in the slepton 
mass matrix are induced by the running of the param- 
eters from the heavy right-handed neutrino scale to the 
electroweak symmetry breaking scale. 

The effects are particularly enhanced at large tan/? 
and if the SUSY spectrum is beyond the TeV range LFV 
T-decays like r ^ ^77 and t ^ fij are pushed near the 
experimental upper limit and their search can be refined 
or expected to give a positive result both at the LHC 
and at a super-B factory. At the same time also lepton 
flavor conserving processes like the B-physics channels 
B jjL^ iJL~ , B TV and B — > Xsj have high sensitivity 
to the above scenario and put severe constraints on the 
parameter space. 

At forthcoming LHC experiments the heavy neutral 
Higgs bosons can be produced copiously and the decay 
{A,H) fiT detected [1, 0. An analysis at the future 
ILC in the e+e" mode was carried out in Ref. JT^. In this 
paper we extend this analysis to explore the potential of 
a photon collider, which is known to be an interesting 
option of the ILC, in detecting LFV signal mediated by 
heavy neutral Higgs bosons of the MSSM. In 14] it was 
shown that within the considered scenario the process 
77 —^ Trbb (rr-fusion) is the principal mechanism for 
heavy Higgs production in photon-photon collisions and 
that it allows to measure tan /3 with a precision which 
is better than that obtainable at the LHC. In this work 
we show that in 77 collisions the dominant channel for 
the lepton flavor violating process 77 — > ^rbb is that 



in which the colliding photons split respectively into a 
/i-pair and r-pair and the two virtual leptons (fir) an- 
nihilate into the Higgs which decay into a bb, Fig. [Ija). 
We give both an analytical approximation of the cross 
section and a detailed numerical study of the signal by 
evaluation of the contributing diagrams discussing back- 
ground and the necessary cuts to isolate the signal. The 
observability of the signal has been studied by imposing 
on the large parameter space the constraints on the SUSY 
spectrum obtained by electro- weak precision observables, 
direct search, B physics and experimental upper bounds 
on the rare t-LFV decays. We have considered as ref- 
erence values of the technical parameters of the photon 
collider those of the TESLA project assuming an inte- 
grated luminosity 0(200 - 500) fb" Vyr and ys:^ = 600 
GeV. 

Let us finally summarize the results obtained in this 
work: i) for large values of tan/3, (30 < tan/3 < 60) the 
cross of 77 — > urbb goes from 10~^ fb up to a few fb 
for higgs bosons masses ranging from Ma,h > 150 up 
to the kinematical limit, 600 GeV; ii) the heavy neutral 
Higgs {A, H) are practically degenerate in mass and give 
the same contribution to the signal cross section; Hi) 
the /I and r leptons are emitted preferentially back-to- 
back and are characterized by high energy and low trans- 
verse momentum. A cut on the energy up to 50 GeV can 
be safely applied without affecting very much the cross- 
section while on the contrary a cut on transverse momen- 
tum would decrease the signal cross-section drastically. 
The b-tagged jets from the Higgs decay have invariant 
mass distributions which are peaked at the Higgs mass. 
A cut on the invariant mass is sufficient to reduce signif- 
icantly the background; iv) low energy constraints put 
further conditions on the observability of the signal: the 
parameter space is restricted to those regions which are 
allowed by the low energy constraint and there we look 
for points were the signal cross section are in the range 
10^^ — 10" fb or cr > 10~^, giving up to 250 events/yr 
for the high luminosity option and up to 100 events/yr 
for the low luminosity case; v) once the low energy con- 
straints are applied to the parameter space we find that 
the lepton flavor violating signal can be probed for masses 
of the heavy neutral Higgs bosons A, H from 300 GeV up 
to the kinematical limit ~ 600 GeV for 30< tan /3 <60. 
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